随着共同群众在社交媒体中的参与不断上升,政策制定者/记者在社交媒体上进行在线民意调查以了解人们在特定地点的政治倾向是越来越普遍的。这里的警告是,只有有影响力的人才能进行这样的在线民意调查并大规模伸展。此外,在这种情况下,选民的分配是不可控制的,实际上可能是有偏见的。另一方面,如果我们可以通过社交媒体解释公开可用的数据来探究用户的政治倾向,我们将能够对调查人群有可控的见解,保持低调的成本,并在没有公开数据的情况下收集公开可用的数据涉及有关人员。因此,我们引入了一个自我牵键的半监督框架,以进一步进一步实现这一目标。我们模型的优点是它既不需要大量的培训数据,也不需要存储社交网络参数。然而,它在没有带注释的数据的情况下达到了93.7 \%的精度。此外,每个课程只有几个注释的示例可以实现竞争性能。我们发现,即使在资源约束的设置中,该模型也是高效的,并且从其预测中得出的见解与手动调查结果相匹配时,将其应用于不同的现实生活中。
translated by 谷歌翻译
在法律文本中预先培训的基于变压器的预训练语言模型(PLM)的出现,法律领域中的自然语言处理受益匪浅。有经过欧洲和美国法律文本的PLM,最著名的是Legalbert。但是,随着印度法律文件的NLP申请量的迅速增加以及印度法律文本的区别特征,也有必要在印度法律文本上预先培训LMS。在这项工作中,我们在大量的印度法律文件中介绍了基于变压器的PLM。我们还将这些PLM应用于印度法律文件的几个基准法律NLP任务,即从事实,法院判决的语义细分和法院判决预测中的法律法规识别。我们的实验证明了这项工作中开发的印度特定PLM的实用性。
translated by 谷歌翻译
复合现象在梵语中无处不在。它用于表达思想的简洁性,同时丰富语言的词汇和结构形成。在这项工作中,我们专注于梵语复合类型标识(SACTI)任务,在其中我们考虑了识别复合词组件之间语义关系的问题。早期的方法仅依赖于从组件获得的词汇信息,而忽略最关键的上下文和句法信息,对SACTI有用。但是,SACTI任务主要是由于化合物组件之间隐式编码的上下文敏感语义关系。因此,我们提出了一种新颖的多任务学习体系结构,该体系结构结合了上下文信息,并使用形态标记和依赖性解析作为两个辅助任务来丰富互补的句法信息。与最新系统相比,SACTI基准数据集上的实验显示了6.1分(准确性)和7.7点(F1得分)绝对增益。此外,我们的多语言实验证明了拟议的架构在英语和马拉地语中的功效。代码和数据集可在https://github.com/ashishgupta2598/sacti上公开获得。
translated by 谷歌翻译
产品的属性值是任何电子商务平台中必不可少的组件。属性值提取(AVE)涉及从其标题或描述中提取产品的属性及其值。在本文中,我们建议使用生成框架解决AVE任务。我们通过将AVE任务作为生成问题制定,即基于单词序列和基于位置的生成范式,即基于单词序列和位置序列。我们在两个数据集上进行实验,在该数据集中生成方法获得了新的最新结果。这表明我们可以将建议的框架用于AVE任务,而无需其他标记或特定于任务的模型设计。
translated by 谷歌翻译
Natural Language Generation (NLG) represents a large collection of tasks in the field of NLP. While many of these tasks have been tackled well by the cross-entropy (CE) loss, the task of dialog generation poses a few unique challenges for this loss function. First, CE loss assumes that for any given input, the only possible output is the one available as the ground truth in the training dataset. In general, this is not true for any task, as there can be multiple semantically equivalent sentences, each with a different surface form. This problem gets exaggerated further for the dialog generation task, as there can be multiple valid responses (for a given context) that not only have different surface forms but are also not semantically equivalent. Second, CE loss does not take the context into consideration while processing the response and, hence, it treats all ground truths with equal importance irrespective of the context. But, we may want our final agent to avoid certain classes of responses (e.g. bland, non-informative or biased responses) and give relatively higher weightage for more context-specific responses. To circumvent these shortcomings of the CE loss, in this paper, we propose a novel loss function, CORAL, that directly optimizes recently proposed estimates of human preference for generated responses. Using CORAL, we can train dialog generation models without assuming non-existence of response other than the ground-truth. Also, the CORAL loss is computed based on both the context and the response. Extensive comparisons on two benchmark datasets show that the proposed methods outperform strong state-of-the-art baseline models of different sizes.
translated by 谷歌翻译
如今,对混合代码的兴趣已在自然语言处理(NLP)中变得普遍存在;但是,对于语音翻译(ST)任务解决这一现象并没有太多关注。这完全可以归因于缺乏由代码混合的ST任务标记数据。因此,我们介绍了Prabhupadavani,这是一种用于25种语言的多语言代码混合ST数据集。它是多域的,涵盖了十个语言家庭,其中包含130多名演讲者的94小时语音,并手动与目标语言的相应文本保持一致。 Prabhupadavani是关于吠陀文化和遗产的文献,在文献中引用文学的情况下,在人文教学的背景下,代码转换很重要。据我们所知,Prabhupadvani是ST文献中第一个可用的多语言代码混合ST数据集。该数据也可用于代码混合的机器翻译任务。所有数据集可以在https://github.com/frozentoad9/cmst上访问。
translated by 谷歌翻译
法律法规识别的任务(LSI)旨在确定与法律案件的给定的事实或证据的描述相关的法律法规。现有方法仅利用事实和法律文章的文本内容来指导此类任务。但是,案例文件和法律法规之间的引文网络是一个丰富的附加信息来源,这是现有模型的考虑。在这项工作中,我们采取第一步利用LSI任务的文本和法律引文网络。我们为这项任务策划了一个大型新型数据集,包括来自印度若干主要法院的案例,以及来自印度刑法(IPC)的法规。将法规和培训文档建模为异构图,我们提出的模型Lesicin可以学习丰富的文本和图形功能,并且还可以调整本身来关联这些功能。此后,该模型可用于感应地预测测试文档(其图形特征不可用的新节点)和法规(现有节点)之间的链接。关于数据集的广泛实验表明,我们的模型通过利用图形结构以及文本特征来舒适地舒适地优于若干最先进的基线。数据集和我们的代码可用于https://github.com/law-ai/lesicin。
translated by 谷歌翻译
从数据学习动态模型在工程设计,优化和预测中起着重要作用。使用经验知识或第一个原则描述复杂过程(例如,天气动态或反应流量)的动态的建筑模型是繁重或不可行的。此外,这些模型是高维但空间相关的。然而,观察到高保真模型的动态经常在低维歧管中发展。此外,还已知用于定义非线性动力学的足够平滑的矢量场,二次模型可以在适当的坐标系中准确地描述它,赋予非透露优化中的McCormick松弛思想。在这里,我们的目标是找到高保真动态数据的低维嵌入,确保了一个简单的二次模型来解释其动态。为此目的,这项工作利用深度学习来识别高保真动态系统的低维二次嵌入。精确地,我们使用autoencoder识别数据嵌入数据以具有嵌入的所需属性。我们还嵌入了漫游 - 库特塔方法,以避免时间衍生计算,这通常是一个挑战。我们说明了在描述流动动态和振荡管式反应器模型中产生的几个示例的方法的能力。
translated by 谷歌翻译
and widely used information measurement metric, particularly popularized for SSVEP- based Brain-Computer (BCI) interfaces. By combining speed and accuracy into a single-valued parameter, this metric aids in the evaluation and comparison of various target identification algorithms across different BCI communities. To accurately depict performance and inspire an end-to-end design for futuristic BCI designs, a more thorough examination and definition of ITR is therefore required. We model the symbiotic communication medium, hosted by the retinogeniculate visual pathway, as a discrete memoryless channel and use the modified capacity expressions to redefine the ITR. We use graph theory to characterize the relationship between the asymmetry of the transition statistics and the ITR gain with the new definition, leading to potential bounds on data rate performance. On two well-known SSVEP datasets, we compared two cutting-edge target identification methods. Results indicate that the induced DM channel asymmetry has a greater impact on the actual perceived ITR than the change in input distribution. Moreover, it is demonstrated that the ITR gain under the new definition is inversely correlated with the asymmetry in the channel transition statistics. Individual input customizations are further shown to yield perceived ITR performance improvements. An algorithm is proposed to find the capacity of binary classification and further discussions are given to extend such results to ensemble techniques.We anticipate that the results of our study will contribute to the characterization of the highly dynamic BCI channel capacities, performance thresholds, and improved BCI stimulus designs for a tighter symbiosis between the human brain and computer systems while enhancing the efficiency of the underlying communication resources.
translated by 谷歌翻译
Object movement identification is one of the most researched problems in the field of computer vision. In this task, we try to classify a pixel as foreground or background. Even though numerous traditional machine learning and deep learning methods already exist for this problem, the two major issues with most of them are the need for large amounts of ground truth data and their inferior performance on unseen videos. Since every pixel of every frame has to be labeled, acquiring large amounts of data for these techniques gets rather expensive. Recently, Zhao et al. [1] proposed one of a kind Arithmetic Distribution Neural Network (ADNN) for universal background subtraction which utilizes probability information from the histogram of temporal pixels and achieves promising results. Building onto this work, we developed an intelligent video surveillance system that uses ADNN architecture for motion detection, trims the video with parts only containing motion, and performs anomaly detection on the trimmed video.
translated by 谷歌翻译